DERIVATION OF AN UPPER BOUND OF THE CONSTANT IN 
THE ERROR BOUND FOR A NEAR BEST M-TERM 

APPROXIMATION 



WOLFGANG KARCHER, HANS-PETER SCHEFFLER, AND EVGENY SPODAREV 



Abstract. In 0], Temlyakov provides an error bound for a near best m-term 
approximation of a function g £ LP([0, l]'^), 1 < p < oo, d e N, using a basis L^- 
equivalent to the Haar system H. The bound includes a constant C{p) that is not 
given expUcitly. The goal of this paper is to find an upper bound of the constant 
for the Haar system H, following the proof in [4]. 



1. Determining the constant in the one-dimensional case 

Let H := {Hj}i be the Haar basis in Lp[0, 1] indexed by dyadic intervals 
/ = [(j - 1)2-", j2-"), J = 1, 2", n = 0, 1, ... and I = [0, 1] with 

if[o,i](x) = 1 for X e [0,1), 

r2-/2, :r e [(j-l)2-",(j-i)2-), 
^^[a-i)2-"j2-")(x) = <^-2-"/2, xG [(j-|)2-",j2""), 

0, otherwise. 



Let 



where 



and denote 



f = J2^iif)Hi, 
I 

ci{f) :={f,Hj)= ! f{x)Hj{x)dx, 
Jo 

ci{f,p) ■■= \\ci{f)Hi\\p. 



Then ci{f,p) — > as |/| 0. 
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Denote by A„i a set of m dyadic intervals / such that 

min ci{f,p) > maxcj{f,p). 

This means that contains the m largest values of cj{f,p) where / runs through 
all dyadic intervals. Then we define the Greedy algorithm G^{-,H) as 



The following theorem provides an error bound for the approximation of a function 
/ G LP[0, 1] by the Greedy algorithm GP^{-,n): 



Theorem 1.1. Let 1 < p < oo. Then for any g G Lp[0, 1], we have 

( . \ 



2 + 



i i r 

max p, 



1 ■ o-m(5')f 



Proof. The Littlewood-Paley theorem for the Haar system gives for 1 < p < oo 



Csip) 



< \ \g\\p< Ciip) 



(1) 



In case of g being a martingale, explicit formulas for these constants are known 
(cf. [1]). In Lemma [HH page El it is shown that the Haar series 

9 = ^ci{g)Hj 
I 

is in fact a (conditionally symmetric) martingale. 
Thus, taking the constants in [T], page 87, we have 



Csip) 



max Ip,^) - I 



and C4{p) = max I p 



p 



p — 1 



- 1. 



Let T^n be an m-term Haar polynomial of best m-term approximation to g in Lp[0, 1]: 



Tm = ^aiHi, |A| 



m. 
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For any finite set Q of dyadic intervals we denote by Sq the projector 

I&Q 

With these definitions, one can derive the following inequality: 

\\9-SK{g)\\p = \\g -Tm,- SAig -Tm)\\p 

< \\Id — SA\\p^pO'mig)p 

< C4ip)C3{py^amig)p, 

where Id denotes the identical operator. The last inequality holds since 

\\9\\p < 1 

implies by the Littlewood-Paley theorem (cf. ([I])) that 



J2\ci{g)Hj\ 



so that by again applying ([1]) we get 



\\{Id-SA){g)l 



With C^ij)) and C^ij)) given above we have 



\g - SK{g)\\p < (^max ~ ^ 



(^m{g)i 



(2) 



Since 



Glr{9) = SA^{g), 
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we have 



h - Gl 
< Wg - Sa 



m ( 

< I max I p, 



m Vy/ IIP 



P 



p — 1 



It remains to estimate ||5'a(5') — 5'a„ 
\\Sa{9) - SaMWp 



1 ■ crm{g)p+\\SAig) - Sa„ 



appropriately: 



II'S'a\a,„(5') - 'S'a,„\a 



< 115, 



A\A„ 



\S 



A^\A{g)\\p- 



The second term in the last expression can be estimated by 
I|5'a„\a 



= II {Id - S'(A„\A)c) 
= Ik - - >S'a(JA£(5' - ^m)||p 
< II Id — S'aua£ II p-^pOrm(5')p 

C,{p) 



< 



CM 



max p 



<^mig)p 



p 



p — 1 



1 ■ (^m{g)t 



Furthermore 



A\Ar, 



< 



,)1/P 



\s, 



A,^\A{g)\\p 



which will be derived in the following lemmas (Lemma ll.2l - I1.5l) . 
Combining ([3])-(l6|), we get 



|^7-G^(^7)||p< 



v 



( ( p 

l^max [p, -—^ 



1 ■ (ym{g)p- 
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Lemma 1.2. Let ni < n2 < ■ ■ ■ < Us be integers and let Ej C [0, 1] be measurable 
sets, j = 1, s. Then for any < q < oo we have 

where Xi(') ^he characteristic Junction of the interval I: 



1, X e I, 
0, I. 



Proof. Denote 



and estimate it on the sets 

s 

Ef:=Ei\ [j Ek, l = l,...,s-l; E; := E, 

k=l+l 



We have for x E E^ 



I 

F{x) < ^2"^/« 



'2ni/g 

2'''/' TT^ + ••• + ! 



i=0 ^ / 



1/9- 



Therefore, 



/ F(xydx< ( ^—rr^ y2"M£;r| < ( ^—rr\ Y 2''^\Ei\, 

which proves the lemma. □ 
Lemma 1.3. Consider 

/ = 5^c,i/,, \Q\ = N. 
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Let 1 < p < oo. Assume that 

\\cjHj\\p<l, leQ. (7) 

Then 



< 



Proof. Denote by ni < n2 < ■ ■ ■ < all integers such that there is / G Q with 
1/1 = 2^"^. Introduce the sets 



U 



l£Q:\I\=2~"-i 

Then the number of elements in Q can be written in the form 

s 



Furthermore, we have 



\ci 



Hj\L=\cj\\I\'/'^-y\ 



The assumption (JT]) implies |c/| < |/|^^^ Next, we have 







< 






p 



X] 



The right hand side of this inequality cna be rewritten as 

Y :=\ I I > '2''^'PyrJx) 1 dx 



Applying Lemma 11.21 with q = p, we get 

< F < - 



^—-^ ( y \E,\2A = ^—rrN' 

1/2)'/" V^^ J l-(l/2)'/" 



Lemma 1.4. Consider 



Let 1 < p < oo. Assume 



f = J2cjHj, \Q\ = N. 
WcjHjWp > 1, leQ. 



Ip 



□ 
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Then 

\\fL> ii-i-] livVp. 



Proof. Define 

u:=J2ci\ci\-'\I\'/^-'/^Hi, 
leg 

where the bar means complex conjugate number. Then for p' = we have 

\\cAcir^\I\^/P-^'^HAl, = 1 



and, by Lemma fOl 



klip' < — ^^'v""'- 



Consider (f^u). We have on the one hand 

(/,«) = J2\ci\\I\'/'-'^' = J2\\ciHi\\p > N, 
l&Q leQ 

and on the other hand 

{f,u) < II/IIpI|m|Ip', 

so that 



1 



1 - (i) 



which implies 



p 



Lemma 1.5. Let 1 < p < oo. Then for any g G Lp[0, 1] we have 
\\Sa\aM\\p < 7 \ , . 2 • II'5a-\a(^)IIp- 

(i-li)'") 

Proof. Denote 

A := max \\cj{g)Hj\\p and B := min \\ci{g)Hi\\p. 

I£A\A,„ /eAm\A 

Then by the definition of we have 

B> A. 
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Using Lemma fOl we get 

||^A\A„(^7)||p < A i-^ ■ |A \ A„|i/^ < B ^ ■ |A \ A„|i/^ (8) 

Using Lemma [HH we get 



so that 



|A™\A|V^<^ —y^\\SKM9)\\v- (9) 



Since |A| = = m, we have \Am \ A| = |A \ A^l and finally get 

m 1 



'a\aM\\p < B- ^ ■\k\k^\'/^ 
^ ~ (2/ 
1 

(1 - (I) 



© 1 

< -^\\Skr.\!v{g)\\p- 



□ 

Lemma 1.6. Let f G /^^[0, 1]. Then the Haar series 

9 = ^ci{g)Hi 
I 

is a conditionally symmetric martingale. 

Proof. First, we give a definition of a conditionally symmetric martingale (cf. [5] and 

Let {Q, JF, P) be a probability space with a nondecreasing sequence of cr-fields 

{fi, 0} = Jo C J^i C ■ • ■ C J'n C ■ ■ ■ C J^. 

Let if be a real or complex Hilbert space with norm | ■ |. A sequence of if- valued 
strongly integrable functions (/n)n>i is a martingale if for each n > 1, /„ is strongly 
measurable relative to and for n > 2, 

E{dn\J^n-i) = a.e. 
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Here the difference sequence {dn)n>i is defined by fn = Yl^=i^ii n > 1. In the 

oo 

following, we also call the limit f = martingale if the corresponding sequence 

i=l 

(/n)n>i is a martingale. 

A martingale is called conditionally symmetric if and — have the same 
conditional distribution given di, 

We can write the Haar series as 

oo 

g = (/, v)v + Y. 

fe=0 2'=<j<2'=+l-l 

where 



1, xe[0,l), 

0, otherwise, 

Consider the probability space {fl, P} defined by 

Q = [0,1], 

^ = ^([0,1]), 
F{A) = \A\, A^T, 

and the sequence of cr-fields 

{0,0} = {0,0} 

C g[}P, ^'o,o) 

C (7((^, *o,0, *2,l) 

C (7(^, *0,0,*2,l,*3,l) C ••• 

C a{kp, • • • , *2fc,ifc, • • • , *2fc+l-l,ifc, *2fc+l,ifc+l) C 

C T. 



We define 



d^ = (5', dx = (gr, *o,o)*o,o, d2 = (s', *2,i)*2,i, 
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and 

Co = {9,^), Ci = (^,^o,o), C2 = (^,^2,i),--- 

where the indices of (/, . and (/, increase as in the definition of the se- 

quence of cr-fields. 

For each fixed n E Nq and each i = O,--- ,n, each of the sets {x : di{x) = q}, 
{x : di{x) = — Cj}, and {x : di{x) = 0} is either a superset of the support of dn+i or 
each of the sets and the support dn+i are disjoint. This implies that 

^{dn+i = Cn+i\di = ji, i e {l,...,n}), ji e {Ci,-Ci,0}) 
= F{dn+i = -Cn+i\di = ji, i e {1, ...,n}), ji G {q, -q, 0}) 

so that the conditional distribution of dn+i and —dn+i is the same given c?i, c?jj. 
Furthermore, we have K{dn+i\J-'n) = 0. □ 

2. Extension of the calculation to the multidimensional case 

A very common way to extend the Haar basis to [0, l]'^ is given by the following 
construction (cf. [2j). Let E denote the collection of nonzero vertices of [0, l]*^. For 
each e G -E, we define the multivariate functions 

^'{Xu--- ,Xd) ■.= ^''{xi)---^'''{xd), 

where \E'''(x) = (p{x), \l'^(x) = \E'o,o(a^)- Furthermore, let 

<iflf^{x) = 2'"^^'^ ■^^{2''x- j), k>0, 2^= < J, < 2^=+^ - 1, i = l,...,d 

and 

^*(x) = i, xe[o,i]'^. 

Then the collection of functions ^1^, e e E, k > 0,2'' < ji < 2''+^-!, i = l,--- ,d 
forms a basis for L'p[0, 1^. 

By considering the set V of dyadic cubes / which form the supports of the func- 
tions \E'*, "^j i^ and exchanging the notation of \E'*, ^^l ^, to Hi, we can also write the 
multivariate Haar basis as 
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Lemma 2.1. Consider f E Lp[0,1Y with corresponding Haar series 

oo 

/ = EE E if^n^n^- 

eeE k=0 2'=<ji<2'=+i-l 
2=1, •■■ ,d 

Then the inner double sum 

oo 

E E 

k=0 2''<ji<2*+i-l 
i=l,- ,d 

forms a conditionally symmetric martingale on [0, l]*^ for each fixed e E E, but so 
does not the Haar series itself. 

Proof. First we show that the Haar series itself does not form a conditionally sym- 
metric martingale. 

Let us assume that d = 2 and remark that the proof goes analogously for c? > 2. We 
have 

(xi,x2) e [0,1] X [o,i], 

(X1,X2) G [0,1] X (i,l], 

otherwise, 

{XI,X2) G [0,i] X [0,1], 
{xi,x2) e (i,l] X [0,1], 
otherwise, 

(xi,X2) G [0,i] X [0,i] U (1,1] X 
(X1,X2) G (|,1] X [0,|] U [0,|] X (i,l], 
otherwise. 

Therefore, the functions ^I^^q g) ^{o o) O' ^(o o) o '^^^ represented as in Figure[TJ 
Thus 



n^m,o = 


1 (0,0),0 


1, 


(0,0), 


1) 


= 1, 


n^m,o = 


1 (0,0),0 


1, 


= 

(0,0), 


1) 


= 1, 


n^m,o = 


■^l^(o,o),o 


1, 


(0,0), 


1) 


= 1, 



^(l!;i),o(^i'^2) 



^(i!I),o(^i'^2) 



-1, 



^(iJ),o(^l'^2) 
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(0,1) 




(0,0) (1,0) 

Figure 1. The functions ^(o|o)o' *(o!o),o' ^ 



which implies that 



E 


v^(o,o),o 


^(0,1) _ 
(0,0),0 


1, 


^(1,0) _ 
(0,0),0 


E 


V^(o,o),o 


^(1,0) _ 
(0,0),0 


1, 


(o,o),o 


E 


^^(1,0) 
^ (0,0),0 


^(0,1) ^ 
(0,0),0 


1, 


(0,0),0 



Therefore the multiparameter Haar series cannot a martingale. 
Let us now consider the probability space {Q, JF, P) with 

n = [0,1]^ 

^ = ^([0,1]'^), 
F{A) = \A\, AcJ^, 
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with the sequence of cx-fields 

{n,(j)} = a(^^^o,o),o) 

Ca(^^o,o),o,%2),i) C ■■■ 

C ^(^{0,0),0' ■ ■ ■ ' *(3,2),1' ^(2,3),!' *(3,3),l) ^ ' ' ' 

^(^{0,0),0' ■ ■ ■ ' ^(3,3),!' ^(4,4), 25 ^(5,4), 2? ^(6,4), 2? ^(7,4), 2) C ■ • • 
C f^(^(0,0),0) ■ ■ ■ > ^(7,4),2) ^(4,5),2> ^{5,5),2> ^(6,5),2) ^ ■ • • 
C ^ 

for each vertex e E E. We denote this sequence of a- fields by 

J^o = cr(^(o,o),o)' -^1 = f^(^(o,o),0' ^(2,2),i)' ■ ■ • • 

Furthermore, for a fixed e G -E, we consider the partial sums of the inner sums of the 
Haar series 

00 

E E if^n^Mk (10) 

k=0 2'=<ji<2*+i-l 
i=l,---,d 

and show that they form a conditionally symmetric martingale. 
Let us denote the difference sequence ((i„)„>i of (fTOl) by 

do = if, ^{0,0),o)^{0,0),0' di = (/, ^(2,2), 1)^(2,2), 1) ) ■ ■ ■ • 

The corresponding coefficients are denoted by 

C0 = (/,^(0,0),0), Ci = (/,^'^2,2),l)' •••• 

For a fixed k and e E E, the support of the functions is disjoint. Furthermore, 
for / < and e G -E, each of the sets {x : '^'j^i{x) = 1}, {x : '^j^i{x) = —1}, and 
{x : \E'^ ;(a;) = 0} is either a superset of the support of or each of the sets and the 
support of j^, are disjoint. 

This implies that —dn+i and dn+i have the same conditional distribution given 
di, ...,dn and therefore 

EidnlJ'n-l) = 0. 
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Thus, the partial sums of 

oo 

k=0 2''<j,<2*+i-l 
i=l,- ,d 

form a conditionally symmetric martingale. □ 



It is clear that the series (/, \I/*)\E'* + J2 J2 (/; ^j,fc)^j,fc ^1^° a martingale. 

fc=0 2'=<ji<2'=+l-l 
«=!,■■■ 4 



Theorem 2.2. Let 1 < p <2. Then for any g G ^^[0, l]'^ we have 



\g-Gl{g,n)l 
( 



< 



2 + 



Proof. Using Lemma [2Tn we get an estimate for the upper bound in the Littlewood- 
Paley inequality by additionally applying the triangle inequality. Let e* ^ E. Then 



e&E k=0 2'=<i,<2'=+i-l 
2=1, •■■ 4 



< 



k=0 2'=<ji<2'''+i-l 
j=l,--- 4 



< 



eGE\{e*} 



E^4(p) 

e£E 



E E 



fc=0 2*<ji<2'''+i-l 
4=1, ■■■ ,d 



(2^^ - 1) C4(p) 



(11) 
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We now apply the method of duality (cf. [3]) in order to determine the lower bound 
of the Littlewood-Paley inequality. The idea is to consider 



as an element of L^2(^x)) 



S{9) :-- 

that is 

f = 



ci{g)Hj\^ -.lev} 



is considered as a p-integrable function taking values in t^iV). Due to the Hahn- 
Banach theorem, the dual function 7 = {7/(x) : / G V} G -^^pp) is of norm one and 
satisfies 



m 



lev i 



where p' is the conjugate index, i. e. l/p + l/p' = 1. This implies that we can assume 
that 7/ is supported on / and constant on I since in the above formula, only the mean 
value of 7/ over / is important. 



By defining the function 

we have on the one hand 
and on the other hand 

\\S{g)h = \ 



^1 Hj, 



S{h) = ||7||«2(i?) 



^ci{g)-fi>/\r\ 

lev 

{9,h) 

IIs'IIpII^IIp' 

\\g\l{2'^-l)C,{p)\\S{h)\\,, 

\\gl (2'^-l)C^4(p)||||7l|p(7.)||,, 
ll^ll, (2^-l)C4(p). 



< 

m 

< 
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SO that in the multidimensional case, the Littlewood-Paley inequality reads 
1 



< \\9\\p<Cl{p,d) 



(12) 



where d) = (2"' - l) C^ip) = (2^^ - l) (max (p, ^) - . 

Now, the remainder of the proof goes as for the univariate case. We note that 

||^-^a(^)|Ip < Cl{p,dy ■ am{9)p, 
\\SAra\A{g)\\p < Cl{p,dy ■ am{g)p, 

and 



\SA\Aj9)t< 



(l -(!)*)■ 
which will be derived in the following lemmas. 



\SA^\A{g)\\p 



Combining the last three inequalities, we get 
\\9-GM\\p 

< \\g-SA(g)\\p+\\SA(9)-SAjg)\\p 

= \\g - SA{g)\\p+ \\SA\A^{g) - SA^\A{g)\\p 

< \\g - SAig)\\p + \\Sa\aM\\p + \\SArn\Aig)\\p 

( \ 



< 



2 + 



v 



(^{2" - 1) (max (^p, - 1^^ am{g)p. 



□ 



Lemma 2.3. Let ni < n2 < ■ ■ ■ < Us he integers and let Ej C [0, l]'' be measurable 
sets, j — 1, s. Then for any < q < oo we have 



/ (t.^'-^'^'XeA^)] dx< ( 1 



d/q 



Proof. Denote 



F{x) ■.= J2^^''^'XE,{x) 
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and estimate it on the sets 

s 

E-:^Ei\ [j Ek, l^l,...,s-l; Ej -.^ E,. 

k=l+l 

We have for x e E^ 

F{x) < ^2-^'^/^ = 2-^/W^ + ... + l 
j=i V / 

OO X X i 

Therefore, 

which proves the lemma. □ 
Lemma 2.4. Consider 

/ = 5^c,i/,, |g| = iv. 

Let 1 < p < oo. Assume i/iai 

WciHiWp < 1, /eg. (13) 

T/ien 

Proof. Denote by ni < ^2 < • • • < all integers such that there is / e Q with 
|7| = 2~'^"^. Introduce the sets 

Ej U 

IeQ:\I\=2-'^"o 

Then the number N of elements in Q can be written in the form 

s 

N = ^\Ej\2'^''^. 

3=i 
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Furthermore, we have for |/| = 2^'^'^, A; = 0, 1, 2, ■ ■ • 



1/p 



<i _ 2dk/2 _ 2-^^^/? = |c/||/|^/^~"^/^ 



The assumption f [T3ll implies 



Next, we have 



^ |j|l/2-l/p_ 







< 






p 



The right hand side of this inequality can be rewritten as 



Applying Lemma 12.31 with q = p, we get 

<Y < 



I ( |E |2'^"A = — 



d/p 



Lemma 2.5. Consider 



f = J2ciHi, \Q\ = N. 



Let 1 < p < oo. Assume that 



Then 



WcjHjWp > 1, IeQ. 



Proof. Define 



u:=J2ci\ci\-'\I\'^^-'/'Hi, 
leg 



where the bar means complex conjugate number. Then for p = we have 
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and, by Lemma [23] 

\\u\\p' < ^-T^Ari/p'. 

-l-(i)'^/^ 

Consider {f,u). We have on the one hand 

I&Q I&Q 

and on the other hand 

U^U) < ||/||p||M||p/, 

so that 

N < {f,u) < wfUMp' < ii/iip^^r^^'^"' 



which implies 



1 X d/p^ 



Lemma 2.6. Let 1 < p < 00. Then for any g G -^^'''[0, l]'^ we have 
'\Sa\aM\\p < — ;7T2 ■ \\Sa„,\a{9)\\p- 

1 - (1)* 



Proof. Denote 



A := max \\cj{g)Hj\\p and B := min \\ci(g)Hi\\p. 

/eA\A™ /eA^\A 

Then by the definition of we have 

B>A. 

Using Lemma [231 we get 



\\SA\Ajg)\\p < A . _ . |A \ A^|V^ < B ■ _ 

Using Lemma [23, we get 



1 \ d/p^ 

\SA^\Ai9)\\p>B.{l-(-\ 1-|A„\A|Vp 



□ 



^ -lAVA^I^/^ (15) 
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SO that 

|A.\Ar/^ < ^ _^^'^,y/,^ \\SaM9)\\,. (16) 
Taking into account that \Am \ A| = |A \ Am|, we get 

□ 
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